Engineering posts about Load Shedding
Curated summaries and key learnings for engineers working with Load Shedding.
MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet
MetaRoCE is a newly developed RDMA transport protocol specifically designed for AI workloads over commodity Ethernet, aiming to enhance the performance and reliability of data transfer between GPUs...
Databricks Network Configuration delivery to Tens of Millions of Serverless VMs
The article discusses the re-architecture of Databricks' network configuration delivery system for its serverless platform, which launches tens of millions of virtual machines (VMs) daily. The...
How and Why Netflix Built a Real-Time Distributed Graph: Part 3 — Querying the graph with gRPC…
In this article, Netflix engineers Nilesh Mishra and Ajit Koti detail the architecture and design choices behind their Real-Time Distributed Graph (RDG), particularly focusing on the querying layer...
Building Service Topology at Scale: Architecture, Challenges, and Lessons Learned
This article delves into the complexities of constructing a real-time service topology at Netflix scale, focusing on the architectural decisions that facilitate efficient data processing and system...
How Netflix Simplified Batch Compute with Kueue
The article outlines Netflix's transition from its custom Compute Managed Batch (CMB) solution to Kueue, a cloud-native job queueing system designed for batch workloads. This migration was motivated...
Sitar-agent: Building a reliable dynamic configuration sidecar at scale
The article discusses the development of Sitar-agent, a Kubernetes sidecar designed to ensure reliable dynamic configuration delivery at scale for Airbnb's services. It outlines the configuration...
How the lakebase architecture stays resilient to cloud failures
The article discusses the challenges faced by cloud infrastructure due to increased demand for control-plane operations and the need for high availability in database management. It outlines how the...
Rethinking Distributed Systems for Serverless Performance and Reliability
The article explores the evolution of serverless compute for Apache Spark, addressing long-standing architectural challenges that have hindered performance and reliability. It emphasizes the need for...
Rearchitecting the Workflows control plane for the agentic era
The article discusses the rearchitecting of the Workflows control plane to accommodate a shift towards agent-triggered workflows, necessitated by the increasing demand for durable execution engines...
Building a Distributed Persistent Queue That Scaled AI Workloads 5x Under LLM Rate Limits
The article discusses the engineering of a distributed persistent queue that orchestrates AI workloads and human workflows within strict infrastructure limits. It highlights the challenges of scaling...